IMAGE COMPRESSING APPARATUS AND IMAGE 
COMPRESSING METHOD 



Background Of the Invention 

5 1. Field of the Invention 

The present invention relates to an image 
compressing device and an image compressing method, 
O and particularly to an image compression technique 

=J with respect to still pictures, 

if 10 2. Description of the Related Art 
rf As an international standard concerning 

jp* compression/expansion method of still pictures, there 

p is available a JPEG method which ISO and CCITT experts 

Q group ISO/IEC, JTC1/SC2/WG (Joint photographic Experts 

15 Group) has regulated as recommended ITU-T Rec . T81 
ISO/IEC- 10918- 1 . 

Fig. 1 is an explanatory view conceptually 
showing compression/expansion processing of the JPEG 
method. In the compression processing, basically, the 
20 image data DI is compressed in three stages; (1) 

discrete cosine transformation (DCT), (2) quantization, 
and (3) entropy compression to thereby generate the 
JPEG compression data D J . Furthermore, in the 
expansion processing, on the contrary, the compressed 
25 data DJ is expanded at each stage of the (4) each 

marker detection, (5) entropy expansion, (6) reverse 
quantization and (7) reverse DCT to thereby create 



expanded image data DR. 

Here, (1) the DCT is a processing of decomposing 
image data into a frequency coefficient, (2) the 
quantization is processing of cutting down information 
5 quantity in a direction of actively reducing high 
frequency to which the sensitivity of man's eyes is 
low from the DCT coefficient data obtained by the DCT, 
and (3) entropy compression refers to generally known 
reversible compression/expansion, and in base line DCT, 

10 technique based upon the known Huffman encoding 
regulation is used. 

Furthermore, in the JPEG method, there are many 
cases in which compression/expansion processing is 
conducted in a color space such as luminance, color 

15 difference 1 and color difference 2 (YCbCr, YUV or the 
like) to further heighten compression rate by changing 
a sampling ratio in each color space. For example, in 
the case where the original color image data is 
composed of three original color, red, green and blue 

20 (R, G, B) signal, a method is used in which the color 
signal is converted into a luminance color difference 
(Y, Cb, Cr or the like) signal followed by compressing 
the signal and converted the signal again into R, G, B 
signal after expansion. 

25 In this method, such a fact is used that the 

man's eyes are insensitive to the color difference 
coefficient rather than the luminance coefficient. 



That is, the data quantity is decreased by reducing 
the sampling ratio of the color difference coefficient 
as against the luminance coefficient (thinning out 
image data) and the compression rate is raised. 
5 An image data unit comprising 8X8 pixels is 

referred to as a block, also the minimum unit image 
data for conducting image compression processing is 

O referred to as minimum coded unit (hereinafter 

Jtf referred to as MCU). 

^ 10 Figs . 2A and 2B are explanatory views 

r! schematically showing a relation between data sampling 

and MCU. There exists a form such as "a sampling 
p ratio of 4: 1: 1" shown in Fig. 2A for sampling four 

O blocks of luminance signal Y and one block of the 

15 color difference signals Cb and Cr respectively from 
one MCU, or another form such as "a sampling ratio of 
4: 4: 4" shown in Fig. 2B for sampling one block of 
the luminance signal Y and the color difference signal 
Cb and Cr respectively from one MCU, or the like. 
20 Figs . 3A and 3B are views for schematically 

showing the concept of the image block of the 
compressed image data of the JPEG method. In the JPEG 
method, as shown in Fig. 3A, an original image 
composed of arranging the above described block 
25 comprising 8X8 pixels in a vertical and a horizontal 
direction is subsequently subjected to DCT and 
quantization in the block unit . From a difference in 



the characteristic of the first one pixel and other 63 
pixels in the each block, as shown in Fig. 3B, the 
first pixel is referred to as a direct current 
coefficient (hereinafter referred to as "DC 
coefficient") and the remaining 63 pixels are referred 
to as an alternate current coefficient (hereinafter 
referred to as "AC coefficient"). 

In the DC coefficient and the AC coefficient, 
the absolute value of the numeric value and the 
distribution thereof differ from each other. While 
the absolute value of the AC coefficient is relatively 
small, the absolute value of the DC coefficient tends 
to become relatively large. This is because the DC 
coefficient shows the average value of the block. 

In the case where the sampling ratio is 4: 4: 4 
shown in Fig. 2B, the DC coefficient is compressed 
through entropy coding after determining a 
differential value with the DC coefficient of the 
block one ahead for each of the coefficient ( Y , Cb, Cr 
or the like ) . 

As shown in Fig. 3C , a scanning order at the 
time of sampling the original image in the JPEG method 
has a specification such that the original image is 
scanned horizontally from the left to the right in the 
MCU unit, and when the right end is attained, the 
scanning process is lowered by one step in the MCU 
unit so that the original image is scanned 



horizontally again in the MCU unit from the left to 
the right so that such process is repeated up to the 
end of the image data. As shown in Fig. 3C, the AC 
coefficient is obtained such that values of pixels are 
scanned in a zigzag manner in the order of 2, 3, 4, 
63 and 64 and the values are entropy compressed with a 
combination of the zero run length (= 0 run length 
value) of the scan data and a coefficient value which 
is not zero. 

The entropy compression is compression on the 
basis of the Huffman coding regulation. The Huffman 
table, which is generally used, has a short code 
length on the whole when the value of each coefficient 
is smaller. When the value of each coefficient is 
larger, the code length tends to become longer. 
Consequently, when the value of each coefficient is 
smaller, the compression rate becomes higher. 

Incidentally, the reason why the DC coefficient 
assumes a differential value with the DC coefficient 
of the block one ahead unlike the AC coefficient is 
that the value at the time of prediction coding as 
differential information becomes smaller, and the 
compression rate at the time of entropy compression 
coding is raised because it is thought that images 
continue and have a high correlation generally with 
respect to adjacent DC coefficients. 

However, since the DC coefficient always assumes 



data differential between front and rear blocks, there 
arises in some cases a problem in that an expansion 
error is generated in which the following DC 
coefficient data cannot be accurately expanded in the 
case of the generation of data error in the 
communication or the like. 

In order to settle this problem, conventionally, 
a device is made to allow a normal expansion of the 
MCU next to the restart marker (hereinafter, referred 
to as "RST" ) as shown in Fig. 4A even when data error 
is caused in the midway rather than inserting the RST 
in an arbitrary interval of the MCU unit in the data 
stream . 

The RST has a function of disconnecting the 
chain action of the differential compression 
associated with the DC coefficient, and the DC 
coefficient immediately after the RST is designed to 
entropy coding and compressing the result of taking a 
differential with zero. 

Consequently, in the case where the RST appears 
at the time of the expansion, a device is made in such 
a manner that it is not required to calculate the DC 
coefficient immediately after the RST by using a DC 
coefficient of the block one ahead, and data can be 
expanded only with the block. 

However, the insertion of the RST into the data 
stream has an advantage described above while having a 



problem in that the compression rate of the direct 
current coefficient of the image is decreased for the 
following reason. 

As described above, the RST once suspends the 
5 chain of the differential compression of the DC 

coefficient to allow data before and after the data to 
be independent by taking the differential with zero to 
enable the restart of a normal expansion. Thus, 
differential value (in actuality the DC coefficient of 

10 the block is reflected therein as it is) of the direct 
current immediately after the insertion of the RST is 
enlarged. As a result, the compression rate is 
reduced. In particular, in the case where the RST is 
inserted into the position where the correlation 

15 between front and rear images is strong, a penalty is 
large in the reduction of the compression rate of the 
DC coefficient. 

Figs. 4A to 4C schematically show the concept of 
the RST, a restart interval marker, a RST insertion 

20 position by the conventional image compressing 

apparatus, respectively. As shown in Fig. 4A, the RST 
comprises 16 bits, and a total of seven kinds of 
markers exist such as OxFF , OxDO to 0xD6 and 0xD7. 
(Hereinafter described as RSTO , RST1 , RST2 , RST7 in 

25 order of the marker of OxFF, OxDO to 0xD6 and 0xD7). 

In the case where the RST is inserted into the 
image data stream, as shown in Fig. 4C„ the RST is 



inserted in the order of RSTO, RST1 , RST2 , •" . Nest 
to the RST 7 , the RST is inserted again in the order of 
RSTO, RST1 and RST2 

Incidentally , as shown in Fig. 4B r the insertion 

5 interval of the RST is defined at the Ri portion 

(lower 16 bits and the unit set in the MCU unit) of 
the restart interval marker (DRI) composed of 48 bits, 
and is added to the header portion of the JPEG format 
as restart interval information. 

10 Fig. 5 is a block diagram showing a general 

conventional image compressing apparatus employing the 
JPEG method. This conventional image compressing 
apparatus comprises: a setting register group 1 
including a horizontal size setting register 11 for 

15 setting a horizontal size of the image and an interval 
setting register 12 for setting restart interval in a 
MCU unit or the like; an image compression processing 
portion 2 for conducting DCT processing and 
quantization of the image data DI and conducting 

20 entropy compression while inserting RST in a set 

interval; a marker preparation portion 3 for preparing 
a plurality of kinds of markers including a restart 
interval marker (DRI) on the basis of the set value of 
the set register group 1; and a marker addition 

25 portion 4 for adding a plurality of kinds of markers 
to the compressed image data prepared at the image 
compression processing portion 2 to output the data as 



JPEG format image data DJ. 

The image compression processing portion 2 
comprises a DCT portion 21 for conducting DCT 
processing, a quantization portion 22 for quantization, 
5 a RST insertion portion 23 for inserting a restart 
marker (RST), and an entropy compression portion 24 
for conducting entropy compression processing. 

The marker preparation portion 3 includes a 
marker preparing circuit 31 for preparing DRI on the 

10 basis of the set value of the interval setting 
register 12 . 

Next, referring to Fig. 5, there will be 
explained an operation of the conventional image 
compression apparatus and an image compression method. 

15 A predetermined set value is set at each of the 

setting registers 11, 12 of the setting register group 
1. That is, the number of horizontal pixels of the 
image required for compression operation is set in the 
horizontal size setting register 11. In the interval 

20 setting register 12, the restart interval value is set 
in the MCU unit. Next, the image compression 
processing portion 2 conducts quantization by 
subjecting the inputted image data DI to the DCT 
processing. Furthermore, entropy compression is 

25 conducted while inserting the RST in the restart 

interval that is set in the interval setting register 
12 . 



- 10 - 

The marker preparation portion 3 prepares a 
plurality of kinds of markers on the basis of the set 
value of the setting register group 1. That is, the 
marker preparing circuit 31 prepares DRI based on the 
5 setting value of the interval setting register 12 . 

The marker addition portion 4 adds a plurality 
of kinds of markers including the DRI to the 
compressed image data prepared at the image 
compression processing portion 2 to output the data as 

10 the JPEG format image data DJ. 

As shown in Fig. 3C described above, a scanning 
order at the time of sampling an original image in the 
JPEG method is set in such a manner that the original 
image is scanned from left to right in the scanning 

15 line (one line) of MCU unit so that when the scanning 
attains the right end the scanning is lowered by one 
line, and an operation of scanning the original image 
from left to right horizontally by one line is 
repeated up to the end of the image data. 

20 Fig. 6 schematically shows a concept of 

correlation of the DC coefficient in the case that the 
image continues. There will be explained a degree of 
penalty in the reduction of compression rate by the 
insertion position of the RST. In the case where the 

25 image continues like two images A and B having 

continuous data, it is thought that a correlation of 
the DC coefficient showing an average value in the MCU 



unit is generally high and a differential compression 
rate is also high, so that a penalty exerting an 
influence upon the reduction in the compression rate 
is extremely high at the time of the insertion of the 
restart marker between these images A and B. 

In the image compressing apparatus and the image 
compressing method which have been described above, a 
restart marker (RST) is inserted into the data stream 
in an arbitrary interval of the MCU unit in order to 
avoid the expansion error of the DC coefficient data 
caused by the data error. However, the RST has a 
function of interrupting a chain of a differential 
compression associated with the DC coefficient. Thus, 
in the case that the RST is inserted into the position 
where a correlation between front and rear images is 
strong, there is a disadvantage in that a differential 
value of the direct current coefficient immediately 
after the insertion of RST becomes large. As a result, 
the compression rate is reduced. 

As a related art, Japanese Laid Open Patent 
Application ( JP - A- Heisei , 8-32821) discloses an image 
compressing system and an image reproduce system. In 
the image compressing system and the image reproduce 
system, a partial reproduce of the image data can be 
performed at high speed. 

Also, Japanese Laid Open Patent Application ( JPA 
2000-32460) discloses a method for producing selective 



image view and a apparatus thereof. In this technique, 
a partial image is produced from a large compressed 
image or a plurality of images. 

Summary of the Invention 

Therefor, an object of the present invention is 
to provide an image compressing apparatus and a image 
compressing method which are capable of avoiding a 
reduction in the compression rate on the basis of the 
insertion of RST and maintaining a high compression 
rate . 

In order to attain the above object, an image 
compressing apparatus according to a first aspect of 
the present invention employs an image 
compression/expansion method and includes restart 
marker insertion position setting means. The image 
compression/expansion method has a format which 
enables, by inserting a restart marker into data 
stream of the compressed image data in an arbitrary 
interval in advance, a normal expansion operation from 
the minimum coded unit (MCU) which is a minimum 
processing unit of image data for conducting the next 
image compression processing of the restart marker 
even when data error is occurred and data is broken. 
The restart marker insertion position setting means 
automatically set an insertion position of the restart 
marker to a head of a scanning line with least 



correlation between the two image data in a MCU unit 
for each interval of the scanning line which is an 
interval of the MCU unit to the scanning line which is 
arbitrarily set. 
5 In order to attain the above object, an image 

compressing apparatus according to a second aspect of 
the present invention employs an image 
O compression/expansion method and includes a setting 

j§ register group, an image compressing portion, a marker 

S 10 preparing portion, a marker adding portion and a 
rl restart interval calculation portion. The image 

~ compression/expansion method has a format which 

O enables, by inserting a restart marker into data 

m 

□ stream of the compressed image data in an arbitrary 

15 interval in advance, a normal expansion operation from 
the minimum coded unit (MCU) which is a minimum 
processing unit of image data for conducting the next 
image compression processing of the restart marker 
even when data error is occurred and data is broken. 
20 The setting register group has a plurality of 

parameter setting registers for setting each of the 
plurality of the parameters including the image 
horizontal pixel number and a restart line interval 
for setting the restart marker in a scanning line 
25 interval that is an interval of the MCU unit. The 
image compressing portion which performs a discrete 
cosine transformation processing and quantization of 



input image data and performs entropy compressing to 
prepare compressed image data while inserting the 
restart marker in a set interval of a restart marker. 
The marker preparing portion prepares markers 
including a restart interval marker showing an 
insertion position of the restart marker on the basis 
of set value of each register of the set register 
group and on a value of a restart interval. The 
marker adding portion adds each marker to the 
compressed image data prepared in the image 
compressing portion and outputting as the image data 
of the predetermined format. The restart interval 
calculation portion calculates the restart interval on 
the basis of the horizontal pixel number and the 
restart line interval of the image supplied from the 
set register group. 

In the image compressing apparatus according to 
the second aspect of the present invention, the set 
register group can be constituted in such a manner 
that a horizontal size setting register for setting a 
horizontal pixel number of the image required for the 
compression operation and a restart line interval 
setting register for setting the restart marker line 
interval value are provided. 

In the image compressing apparatus according to 
the second aspect of the invention, the image 
compression processing portion comprises a discrete 



cosine transformation portion for conducting the 
discrete cosine transformation processing, a 
quantization portion for conducting quantization of 
data which is subjected to the discrete cosine 
transformation, a restart marker insertion portion for 
inserting the restart marker to the output data of the 
quantization portion and an entropy compression 
portion for entropy compression processing of the data 
into which the restart marker is inserted. 

In the image compressing apparatus according to 
the second aspect of the present invention, the marker 
preparation portion comprises a restart interval 
marker preparation circuit for preparing the restart 
interval marker on the basis of the value of the 
restart interval calculated in the restart interval 
calculation portion. 

In the image compressing apparatus according to 
the second aspect of the present invention, the 
restart interval calculation portion can be 
constituted so as to be determine an MCU number per 
one scanning by dividing the horizontal pixel number 
with the horizontal pixel number of the MCU unit and 
multiplying the value of the restart line interval 
with the MCU number per one scanning line. 

In order to attain the above object, an image 
compressing method according to third aspect of the 
present invention employs an image 



compression/expansion method having a format which 
enables, by inserting the restart marker into data 
stream of the compressed image data in an arbitrary 
interval in advance, a normal expansion operation from 
the minimum coding unit ( MCU ) which is a minimum 
processing unit of image data for conducting the next 
image compression processing of the restart marker 
even when data error is occurred and data is broken, 
the method characterized in that an insertion position 
of the restart marker is automatically set to a head 
of a scanning line with least correlation between the 
two image data in a MCU unit for each interval of the 
scanning line which is an interval of the MCU unit of 
the scanning line which is arbitrarily set. 

In order to attain the above object, an image 
compressing method according to a fourth aspect of the 
present invention employs an image 

compression/expansion method having a format which 
enables, by inserting the restart marker into the data 
stream of the compressed image data in an arbitrary 
interval in advance, a normal expansion operation from 
the minimum coding unit (MCU) which is a minimum 
processing unit of image data for conducting the next 
image compression processing of the restart marker 
even when data error is occurred and data is broken, 
the method comprises a first step of setting a 
plurality of parameters including a horizontal pixel 
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number of the images required for compression, and a 
restart interval; a second step of determining in 
calculation a restart interval value of he MCU unit 
from the image horizontal pixel number and the restart 

5 line interval set at the first step; a third step of 
preparing each marker in accordance with a 
predetermined format standard from each of parameters 
set at the first step and the restart interval value 
determined at step 2; a fourth step of starting the 

10 incorporation of the image data on the basis of each 

of the parameters set at the second step; a fifth step 
of conducting discrete cosine transformation for 
decomposing the image data incorporated at the fourth 
step to frequency coefficient; a sixth step of 

15 quantifying the discrete cosine transformation 
coefficient obtained at the fifth step in the 
direction of more actively a high frequency 
coefficient to which man's eye is insensitive; a 
seventh step of subsequently inserting the restart 

20 marker at an appropriate timing on the basis of the 

calculation result at the second step while subjecting 
to entropy compression quantization data obtained at 
the sixth step; and an eighth step of adding each of 
the marker obtained at the third step to the image 

25 data compressed at the fourth to seventh step as 
header information. 

In the image compressing method according to the 
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fourth aspect of the present invention, in the second 
step, the horizontal pixel number is divided by the 
MCU unit horizontal pixel number to determine the MCU 
number per one scanning followed by multiplying the 
5 restart line interval value. 



Brief Description of the Drawings 

Fig. 1 is an explanatory view conceptually 
showing a compression/expansion process of the JPEG 
10 method; 

Figs. 2A and 2B are explanatory views 
schematically showing a relation between a MCU and 
data sampling of compressed image data of the JPEG 
method ; 

15 Figs. 3A to 3D are explanatory views 

schematically showing a concept of an image block of 

the compressed image data of the JPEG method; 
Figs. 4A to 4C are explanatory views 

schematically showing a concept of a restart marker, a 
20 restart interval marker, and an insertion position of 

the restart marker of the conventional image 

compressing apparatus respectively; 

Fig. 5 is a block diagram showing one example of 

the conventional image compressing apparatus; 
25 Fig. 6 is an explanatory view schematically 

showing a concept of a correlation of a DC coefficient 

in the case that images continue; 



Fig. 7 is a block diagram showing an image 
compressing apparatus according to a first embodiment 
of the present invention ; 

Figs. 8A and 8B are explanatory views 
5 schematically showing a restart marker insertion 

position by the image compressing apparatus according 
to a first embodiment of the present invention; and 
Fig. 9 is a flowchart showing an image 
rS compressing method according to a second embodiment of 

q 10 the present invention. 

m 

Cj Description Of The Preferred Embodiments 

O Now, embodiments of the present invention will 

O be explained in detail by referring to the attached 

O 15 drawings. 

An image compressing apparatus and a image 
compressing method according to an embodiment of the 
present invention is applied to an image 
compression/expansion processing of JPEG method which 
20 is an international standard about the 

compression/expansion of a still picture which has 
been explained in the prior art, and is particularly 
applied to the image compression processing. In a 
format of the JPEG method, there is provided such a 
25 specification that image data can be normally expanded 
from the minimum coded unit (MCU) or the block next to 
the RST even in the case where data error is generated 
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and data is broken in communication or the like by 
inserting the restart marker (RST) in an arbitrary 
interval in advance. 

However, in the JPEG method, the direct current 

5 coefficient created with the discrete cosine 

transformation and quantization of the original image 
is subjected to the differential compression with the 
prediction coding, followed by entropy coding to 
heighten the compression rate. The insertion of the 

10 RST allows the independence of the data before and 
after the differential compression by temporarily 
suspending the chain of the differential compression 
and taking a difference with zero to enable the 
restart of the expansion. Thus, difference value of 

15 the direct current immediately after the insertion of 
the RST is enlarged. As a result, the compression 
rate is lowered. 

Therefore, the image compressing apparatus and a 
image compressing method according to the embodiment 

20 of the present invention is characterized by 

heightening the compression rate at the time of the 
RST insertion by providing RST insertion position 
setting means. The RST insertion position setting 
means, in order to minimize a penalty of the reduction 

25 in the compression rate caused by the insertion of the 
RST, automatically sets the insertion position of he 
RST to the head of the scanning line with the least 
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correlation between two piece of image data in the MCU 
unit for each interval of the scanning line which is 
an interval of the MCU unit of the scanning line which 
is arbitrarily set. 
5 It should be noted that terms such as the 

compression/expansion processing of the JPEG method 
and the MCU, the block, the RST or the like has been 
explained in detail in the prior art. Therefor, an 
explanation thereof is not repeated here. 

10 Next, there will be explained an image 

compressing apparatus according to an embodiment of 
the present invention by referring to a block diagram 
shown in Fig. 7. This image compressing apparatus 
comprises an image compression processing portion 2, a 

15 marker preparation portion 3, a marker addition 

portion 4, a setting register group 1A and a restart 
interval calculation portion 5. A specification 
portion of the present invention is composed of the 
set register group 1A and a restart interval 

20 calculation portion 5. 

The image compression processing portion 2, the 
marker preparation portion 3 and the marker addition 
portion 4 are common with the prior art. The image 
compression processing portion 2 executes entropy 

25 compression while inserting an RST in an interval set 
through the discrete cosine transformation (DCT) 
processing and quantization of the image data DI . The 
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marker preparation portion 3 prepares each marker 
including a restart interval marker (DRI) for setting 
the insertion position of the RST on the basis of the 
set value of each register of the set register group 

5 1A and a restart interval value (will be described 

later). The marker addition portion 4 adds each kind 
of marker to the compressed image data prepared at the 
image compression processing portion 2 and outputs the 
data as JPEG format image data DJ. The setting 

10 register group 1A includes parameter setting registers 
for respectively setting a restart line interval for 
setting the RST described later in a scanning line 
interval of the MCU unit instead of the setting 
register group 1 and parameters of the JPEG 

15 compression operation including a horizontal pixel 
number of images. The restart interval calculation 
portion 5 calculates the restart interval on the basis 
of the horizontal pixel number H of images supplied 
from the setting register group 1A and the restart 

20 line interval. 

The setting register group 1A includes a 
horizontal size setting register 11 for setting the 
horizontal pixel number H of the image required for 
the compression operation, and a restart line interval 

25 setting register 13 for setting a line interval value 
of the RST . 

The image compression processing portion 2 



comprises a DCT portion 21 for conducting DCT 
processing, a quantization portion 22 for conducting 
quantization, a RST insertion portion 23 for inserting 
a restart marker (RST), and an entropy compression 
portion 24 for conducting entropy compression. 

The marker preparation portion 3 comprises a 
marker preparation circuit 31 for preparing a DRI on 
the basis of the value of the restart interval value 
calculated with the restart interval calculation 
portion 5. 

Next, referring to Fig. 7, there will be 
explained an operation of the image compressing 
apparatus according to embodiments of the present 
invention. In the beginning, predetermined values are 
set in setting registers including the horizontal size 
setting register 11 and the restart line interval 
setting register 13 of the setting register group 1A, 
respectively. That is, the horizontal pixel number H 
of the image required for the compression operation is 
set in the horizontal size setting register 11. In 
the restart line interval setting register 13, an 
interval value L of the restart line is set for 
setting the RST insertion interval in the unit of the 
scanning line (hereinafter simply referred to as a 
line) expressed in the MCU unit such as, for example, 
for each one (MCU) line or every two lines. 

The restart interval calculation portion 5 



calculates the RST insertion interval based on the 
horizontal pixel number H and the interval value L of 
the restart line, that is, the restart interval value 
Ri of the MCU unit and outputs the RST at a timing at 

5 which the RST is inserted and at the head of the set 
scanning line for each of the interval value L. 

The restart interval value Ri is calculated by 
determining how many MCUs are required for the 
scanning of the horizontal image number H of the 
10 original image in the beginning, that is, determining 
the MCU number Hn per one scanning from the equation 
of "H * horizontal pixel number Mh in MCU unit = Hn 
(rounded up)" followed by multiplying the restart line 
interval value L to the MCU number Hn per one scan (Ri 

15 = Hn x L ) . 

It should be noted that because the MCU unit 
horizontal pixel number Mh used in this calculation 
refers to a horizontal pixel number included in one 
MCU unit, it is required to be considered in the 

20 sample ratio of each of the color components and 

scanning method. For example, the MCU unit horizontal 
pixel number in the case of the interleave method at 
the sample ratio of 4: 4: 4 is 8. 

Next, the image compression processing portion 2 

25 subjects the image data DI inputted at the DCT portion 
21 to the DCT processing, and conducts quantization at 
the quantization portion 22. The entropy compression 
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is conducted at the entropy compression portion 24 to 
output the compressed data DC while inserting into the 
data quantized at the RST insertion portion 23 the RST 
at the head of the scanning line, namely, at the 
5 timing of the RST insertion interval calculated at the 
restart interval calculation portion 5. 

The marker preparation portion 3 prepares a 
plurality of kinds of markers on the basis of the set 
M value of the setting register group 1A and the restart 

= 10 interval which is a calculation result of the restart 
S interval calculation portion 5. That is, DRI 

SI preparation circuit 31 prepares the restart interval 

□ marker (DRI) on the basis of the calculated restart 

O interval. Furthermore, the head marker SQT of the 

D 15 JPEG data stream regulated in the JPEG method signal 

M> 

format, the quantization table definition marker DQT, 
and a Huffman table definition marker DHT or the like 
are prepared, so that each of these created markers is 
supplied to the marker addition portion 4 . 
20 The marker addition portion 4 adds the markers 

including the DRI, SQT, DQT and DHT to the compressed 
image data DC prepared in the image compression 
processing portion 2 to be output as the JPEG format 
image data D J . 

25 Here, there will be explained the RST insertion 

position (timing) characterizing embodiments of the 
present invention. As shown in Fig. 3C which has been 



described above, the scanning order at the time of 
sampling the original image in the JPEG method is 
specified such that the original image is scanned 
horizontally from the left to the right in the 
scanning line (one line hereinafter) of the MCU unit, 
and when the right end is attained the scanning is 
lowered to a lower stage by one MCU unit, that is, one 
line portion and an operation of horizontally scanning 
from left to right for one line portion is repeated up 
to the end of the original image. 

Here, the penalty degree of the reduction in 
the compression rate in accordance with the RST 
insertion position is explained by referring to Fig. 6 
schematically showing the concept of the correlation 
of the DC coefficient in the case that the image data 
(hereinafter, image) of the one MCU unit is sequential. 
It is thought that the correlation of the DC 
coefficient showing an average value of the MCU unit 
of the images A and B in the case where the data 
continues in the two images A and B is generally high 
and the differential compression rate is also high. 
Thus, the penalty affecting the reduction in the 
compression rate becomes very high when the restart 
marker is inserted between the two images A and B. 

However, like the image C, D, in the case of the 
image C at the end (the most right end) and the image 
D at the head (the most left end) of the next line 



(however, MCU unit), that is, two images spanning the 
line, the images are discontinuous even if the scan 
data order is continuous with the result that the 
correlation between DC coefficients is non-existent or 
considerably low. The compression rate in this case 
becomes extremely low. This fact shows that the 
penalty affecting the reduction in the compression 
rate becomes extremely small even when the RST is 
inserted between the images C and D with no 
correlation or with extremely low correlation. 

Consequently, in this embodiment, the RST 
insertion interval is set in the line unit in which 
the correlation between the blocks (images) is most 
small, and the RST insertion position (timing) is set 
to the head of the line with the least correlation 
between the images. 

As described above, the image compressing 
apparatus according to the embodiment of the present 
invention has such a function that when the arbitrary 
line interval of an RST is only set, the restart 
interval marker (DRI) is automatically added to the 
head position of the scanning line in the data stream 
of the JPEG image for each of this set line. 

Figs. 8A and 8B are views schematically showing 
the concept of the insertion position of the restart 
marker by the image compressing apparatus according to 
the embodiments of the present invention. Fig. 8A is 
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a view showing a case in which "1" is set in the 
restart line interval setting register 13, the view 
showing a state in which RST is set at the head 
position of each line. Here, numeric values 0 to 7 

5 denote the RSTO to 7 respectively. 

In this case, the RST is inserted for each line, 
so that expansion can be normally conducted from the 
head of the next line even when data error is 
generated at the time of the image expansion at a 

10 certain line so that a normal expansion is prevented. 

Fig. 8B is a view showing a case in which "2" is 
set to the restart line interval setting register 13. 
There is shown a state in which RST is set to the head 
position for each of two lines, namely, every two 

15 lines . 

As has been explained in the prior art, 16 bits 
are required per one marker for the insertion of the 
RST. With respect to the compressed image which is 
compressed on the basis of the setting of the restart 

20 line for each of two lines, the insertion of the RST 
can be halved as compared with the compressed image 
based on the restart line interval setting for every 
one line, so that the data quantity becomes smaller 
and the compression rate can be improved. 

25 However, in the case where data error is 

generated and a normal expansion cannot be conducted 
at the time of the image expansion at a certain line 
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because RST is inserted only for every two lines 
(however, MCU unit), normal expansion cannot be 
resumed up to the head after two lines in the worst 
cases . 

5 As describe above, it is possible to further 

reduce the data quantity of the compressed image by 
enlarging the value of the restart line interval 
setting register. For that portion, there arises a 
trade-off relation that a restoration interval becomes 
10 large until the expansion can be normally resumed from 
the occurrence of the data error. 

In this manner, for improving a reduction in the 
compression rate of the DC coefficient at the time of 
the RST insertion, the image compressing apparatus 
P 15 according to this embodiment set the RST insertion 
interval in line unit, and set the RST insertion 
interval position at the head position of the line 
which can be regarded as having the least correlation 
between blocks thereby minimizing the penalty of the 
20 reduction in the compression rate and attempting to 
improve the compression rate at the time of the RST 
insertion . 

Next, there is explained an example in which a 
improved value of the actual compression rate is 
25 predicted by distinguishing respectively the method 
into the interleave scan method (a method for 
subsequently scanning the color component in the MCU 



unit) and a subsequent scanning method (a method for 
subsequently scanning the image in each color 
component unit). 

In the beginning, in the interleave scanning 
5 method, it is assumed that one color pixel is 24 bit 
signal which is composed of components of color 
signals R , G, and B or luminance color-difference 
signals Y, Cb , Cr or the like each of which components 
-*D has eight bit ( 256 levels), the level of each 

y 10 component generally forms a normal distribution, and 
S~ the average of the absolute value of the differential 

of the DC coefficient between continuous MCU is about 
3 6 . 

m Referring again to Fig. 6, the average Q of the 

5 

y* 15 absolute value of the differential of the DC 

coefficient in the case of the continuous images like 
the image data (hereinafter, image) A, B in the MCU 
unit is assumed to be "6" which is a small, and the 
average R of the absolute value of the differential of 
20 the DC coefficient in the case of spanning a line like 
images C and D is assumed to be 128 which is 
relatively large. Furthermore, it is supposed that 
the average value S of the differential of the DC 
coefficient at the time of the RST insertion is 128 
25 with difference to 0. 

The penalty PF in the case of the conventional 
RST insertion method is represented by the equation 



"PF = S-Q = 128-6 = 12 2" . 

On the other hand, the penalty PE in the case of 
the RST insertion method, in this embodiment is 
represented by the equation "PE = S-R = 128-128 = 0". 

Thus, the improvement effect IE per one pixel in 
the present invention is represented by the equation 
"IE = PF-PE = 122-0 = 122" so that the average 122 
level is improved as the differential value per one 
component of the DC coefficient. 

At the time of Huffman coding of the 
differential value in actuality, the differential 
value is represented with a combination of a group 
number to which the differential value belong, and an 
addition bit in which a small value is given in order 
from small value of the DC differential value. 
Consequently, for example, in the case where the 
Huffman table is defined as "group number 3 (3 bits) + 
addition bit [110] (3 bits)=6 bits" with respect to 
value 6, and as "group number 8 (6 bits) + addition 
bits [10000000] (8 bits ) = 14 bits" with respect to the 
value of 128, the differential DC of the coding bit 
becomes DC = 14-6 = 8 bits. 

The improvement rate IF in this case is 
represented by the equation "IF = { 1 - ( 6 -5- 1 4 ) } * l 0 0 = 
about 57%", so that it is expected that the 
improvement rate appears as a difference of about 8 
bits per one restart (However, the above value changes 



in accordance with the setting of the Huffman table). 

Consequently, in this case, the image 
compressing apparatus according to the embodiment on 
the present invention improves the reduction in the 
compression rate of the DC coefficient at the time of 
the RST insertion approximately by an average of 8 
bits per one RST (the improvement rate is about 57%), 
so that the compression rate at the time of RST 
insertion is improved as a result . 

Next, in the case of the subsequent scanning 
method, the original image is sampled one screen after 
another for each component of the image signal with 
the result that when one color pixel is set to 24 bits 
in the same manner as the case of the above interleave 
scanning method, the improvement effect IG per one 
pixel will become three times of the differential DC 
of the coded bit, namely 2IG=DC * 3 = 8 * 3 =242 bits 
is provided. 

In this case, the improvement rate IK will be 
"IK = {1 - (6 *3) * (14 x 3)} x 100 = about 57%". As 
compared with interleave scanning method, a large 
effect of three times (about 24 bits) in terms of bits 
can be obtained. It should be noted that the 
improvement rate of about 57% can be obtained at a 
relative ratio in the same manner. 

Next, an image compressing method according to a 
second embodiment of the present invention will be 



explained while referring a flowchart of Fig. 9. The 
image compressing method can be realized with a 
combination of a general purpose arithmetic unit (CPU 
or the like) and software except for the constitution 
of the image compressing apparatus according to the 
first embodiment with dedicated hardware. 

In this embodiment, basically, the processing 
same as the image compressing apparatus according to 
the first embodiment is subsequently conducted to be 
suitable to software. Steps SI to S3 execute a prior 
preparation for compression, and steps S4 to S8 
execute an actual image compression processing. 

First, after the start of the image compression, 
at step SI, parameters required for compression is set. 
The image horizontal pixel number H, the restart line 
interval L, the image sizes X and Y, each color 
component sample ratio (4: 4: 4 or 4: 1: 1), and the 
scanning method (subsequent scanning method, or 
interleave scanning method) or the like are set. 

Next, at step S2, the restart interval value Ri 
of the MCU unit is determined in the calculation based 
on the image horizontal pixel number H and the restart 
line interval L out of the parameters set at the step 
SI . 

That is, the restart interval value Ri is 
calculated by determining how many MCUs are required 
for scanning of the horizontal pixel number H of the 



original image in the beginning, namely determining 
the MCU number Hn per one scan from an equation of "H 
■f MCU unit horizontal pixel number Mh = Hn (rounded 
up)" followed by multiplying the restart line interval 
value L to the MCU number Hn per one scan (Ri = Hn * 
L) . 

It should be noted that because the MCU unit 
horizontal pixel number Mh used in this calculation 
refers to a horizontal pixel number included in one 
MCU unit. Consequently, it is required to consider 
the horizontal pixel number in terms of the sample 
ratio and the scanning method. For example, the MCU 
unit horizontal number in the case of the interleave 
method becomes 8 at the sample ratio of 4: 4: 4. 

Next, at step S3, each marker is prepared in 
accordance with the JPEG method format standard from 
each parameter set at step SI and the MCU unit restart 
interval value Ri determined at step S2 . 

Next, at step S4 , the incorporation of the image 
data is started on the basis of each of the parameters 
set in the processing at step S2 . 

Next, at step S5, in order to decompose the 
image data incorporated at step S4, discrete cosine 
transformation (DCT) is conducted. 

Next, at step S6 , the DCT coefficient data 
obtained at step S5 is quantized in a direction of 
more actively dropping a high frequency coefficient at 



which the sensitivity of man's eye is low. 

Next, at step S7 , while subjecting the 
quantization data obtained at step S6 to entropy 
compression, the RST (RSTO to RST7) is subsequently 
inserted at an appropriate timing on the basis of the 
calculation result obtained at step S2. 

Next, at step S8, each marker obtained at step 
S3 is added to the image data compressed at step S4 to 
S7 as header information. 

In the completion of step S8 , the compressed 
image data that is JPEG compressed is completed. 

With the above described image compression 
processing method, it is possible to realize the same 
function as the image compressing apparatus according 
to the first embodiment of the present invention. 

As has been explained above, the image 
compressing apparatus and the image compressing method 
are capable of minimizing the penalty of the decrease 
in the compression rate and improving the compression 
rate at the time of the RST insertion by providing a 
RST insertion setting means for automatically setting 
the RST insertion position to the head of the scanning 
line with the least correlation between the two image 
data for each of the scanning line which is 
arbitrarily set so as to set the RST insertion 
interval in the line unit and setting the RST 
insertion position to the head position of the line 
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which can be regarded as the presence of the least 
correlation between the blocks. 



